Aron et ai. Implementation Science 2014, 9:58 
http://www.implementationscience.eom/content/9/1/58 IMPLEMENTATION SCIENCE 



Implementation 
Science 



STUDY PROTOCOL Open Access 



De-implementation of inappropriately tight 
control (of hypoglycemia) for health: protocol 
with an example of a research grant application 

David C Aron 1 , Julie Lowery 2 , Chin-lin Tseng 3 , Paul Conlin 4 and Leila Kahwati 5 



Abstract 

Background: Implementation of practice change is difficult and large scale implementation is particularly difficult. 
Among the challenges facing the healthcare system in general and healthcare organizations is the overuse of low 
value care. Improving medication safety also constitutes an attempt to reduce low value or potentially harmful care. 
Critical issues of overuse of low value practices and medication safety intersect in overtreatment of diabetes. 
Specifically, (over)intensive glycemic control increases hypoglycemia risk and morbidity without providing 
meaningful benefit. Our work indicates that among patients with diabetes who are at high risk for hypoglycemia, 
potential overtreatment is common. The Choosing Wisely Initiative to reduce low value care led by the American 
Board of Internal Medicine Foundation recommends not to treat most persons over 65 years of age with 
medications to reduce the A1c<7.5%. For most physicians this involves a change in practice. We will study the 
implementation of the Veterans Health Administration's Choosing Wisely Initiative (which includes hypoglycemic 
safety as a targeted condition) with three specific aims: (1) to assess the overall impact, both intended and 
unintended, of the Choosing Wisely Initiative to reduce overtreatment of diabetes in especially vulnerable 
populations; (2) to assess the impact of commitment to quality, teaching intensity, and safety culture on likelihood 
of overtreatment; and (3) to identify configurations of the implementation strategy, provider characteristics and 
organizational level factors that are associated with successful reduction of overtreatment rates by comparing high 
and low performers. Because focus on this initiative could have the unintended consequence of paying less 
attention to poor glycemic control (A1c>9%), we will also assess undertreatment. 

Methods/Design: We will take advantage of a natural experiment and use a Type III Hybrid Design that focuses on 
study of implementation while at the same time observing and gathering information on clinical interventions and 
outcomes. This mixed methods study will use longitudinal data and qualitative methods including Qualitative 
Comparative Analyses. 

Discussion: Our multi-paradigm approach to examining potential mechanisms to explain the variation in reduction 
of rates of overtreatment will contribute to a better understanding of implementation of national dissemination 
projects and multi-component interventions in complex systems. 
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Table 1 Ten key ingredients for implementation research proposals (modified from Proctor EK et al. [1]) 



Ten key ingredients 



How ingredients are operationalized 



Evidence of a gap in quality 

Evidence-based treatment to be implemented 
Conceptual model and theoretical justification 

Stakeholder priorities, engagement in change 

Setting's readiness to adopt new services/ treatments/programs 
implementation strategy/process 

Team experience with the setting, treatment, implementation process 

Feasibility of proposed research design and methods 
Measurement and analysis section 

Policy/funding environment; leverage or support for sustaining change 



In addition to support from the literature, research team members were able 
to cite their own work about potential overtreatment of diabetes. Another 
gap is in knowledge about how to de-implement well-established practices. 

Discontinuing treatment that is of little benefit, but potentially harmful is 
valid on its face. 

Both the original application and the revision modified an established 
conceptual model. However, in response to the reviews, the aspects of 
the model related to 'unlearning' were eliminated. 

This project involved assessment of a natural experiment. The priorities 
were set by central administration. However, it occurred in the context 
of similar initiatives in the private sector. 

Preliminary data provided some support for the readiness of the settings, 
but variation is expected and is the focus of the proposal. 

As a natural experiment, implementation strategy and process were 
outside the control of the research team. 

The team members have had a long track record of working together 
in the general area of diabetes care delivery. They have special expertise 
in implementation research as well as operational implementation. 

Feasibility was a major factor in designing a multi-level (national and loca 
facility) study based on different kinds of data. 

This section was one of the largest in the application. 

It is clear that this topic of potential overtreatment of diabetes has gained 
considerable traction: In addition to the Choosing Wisely initiative itself, 
professional societies have adopted the concept of individualization of 
A1c targets and modified their practice guidelines accordingly. 



There are many guides to developing research proposals, 
and ingredients for implementation research grant pro- 
posals have been suggested by Proctor et al. [1]. How- 
ever, among the challenges facing a new investigator in 
trying to get research funding is the relative paucity of 
model grant applications [2,3]. This is particularly true 
when the field being entered is a newly developing dis- 
cipline; implementation science is such a discipline and 
it is still evolving [4]. Although the publication of proto- 
cols from such grant applications has become more 
common, the actual grant application and its iterations 
have not. Our goal is not only to provide an example of 
an implementation research grant application, but also 
to illustrate this process further by making available the 
different iterations and the critiques as well. In so doing, 
we take the process one step further by illustrating how 
the research team revised the application in response to 
the critiques. Each funding agency has its own applica- 
tion procedures. These procedures may differ in the de- 
tails, but are similar. Some require 'letters of intent' or 
'concept papers' while others do not. The revised appli- 
cation is in Additional file 1. We have included in the 
six other additional files labeled: Additional files 2, 3, 4, 
5, 6 and 7.' This process lasted from May 2013 to March 
2014. Of note, in the middle of the process, the funding 
agency changed its requirements between initial and 



revised submissions in terms of the length of the narra- 
tive, reducing it from 25 to 15 pages. 

Proctor et al. identified ten ingredients of a success- 
ful implementation research grant proposal [1]. These 
ingredients are listed in Table 1. All ten ingredients 
were included in our application to varying degrees. 
No claims are made that this is the optimal proposal 
that could be written on the subject, merely that it suf- 
fices, i.e., it was good enough to have been funded suc- 
cessfully [5], and they are highlighted in Table 1. It is the 
hope of the authors that making this material available, 
with all its imperfections, will foster development of this 
crucially important discipline. It should also be stated that 
the process of submission and review resulted in what we 
believe is a much improved proposal. 

Additional files 



Additional file 1: Specific aims. 

Additional file 2: Concept paper. 

Additional file 3: Critiques of the concept paper. 

Additional file 4: Initial submission. 

Additional file 5: Critiques of the initial submission. 

Additional file 6: Response to the critiques. 

Additional file 7: Critiques of the revision. 
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